Induction of Selective Bayesian Classi
نویسنده
چکیده
In this paper, we examine previous work on the naive Bayesian classiier and review its limitations, which include a sensitivity to correlated features. We respond to this problem by embedding the naive Bayesian induction scheme within an algorithm that carries out a greedy search through the space of features. We hypothesize that this approach will improve asymptotic accuracy in domains that involve correlated features without reducing the rate of learning in ones that do not. We report experimental results on six natural domains, including comparisons with decision-tree induction , that support these hypotheses. In closing, we discuss other approaches to extending naive Bayesian classiiers and outline some directions for future research .
منابع مشابه
A Comparison of Induction Algorithms for Selective andnon - Selective Bayesian Classi
In this paper we present a novel induction algorithm for Bayesian networks. This selective Bayesian network classiier selects a subset of attributes that maximizes predictive accuracy prior to the network learning phase, thereby learning Bayesian networks with a bias for small, high-predictive-accuracy networks. We compare the performance of this classiier with selective and non-selective naive...
متن کاملAdjusted Probability Naive Bayesian Induction
Naive Bayesian classi ers utilise a simple mathematical model for induction. While it is known that the assumptions on which this model is based are frequently violated, the predictive accuracy obtained in discriminate classi cation tasks is surprisingly competitive in comparison to more complex induction techniques. Adjusted probability naive Bayesian induction adds a simple extension to the n...
متن کاملcient Learning of Selective Bayesian Network Classi
In this paper, we present a computation-ally eecient method for inducing selective Bayesian network classiiers. Our approach is to use information-theoretic metrics to ef-ciently select a subset of attributes from which to learn the classiier. We explore three conditional, information-theoretic met-rics that are extensions of metrics used extensively in decision tree learning, namely Quin-lan's...
متن کاملBayesian Classi cation
Bayesian classi cation addresses the classi cation problem by learning the distribution of instances given di erent class values. We review the basic notion of Bayesian classi cation, describe in some detail the naive Bayesian classi er, and brie y discuss some extensions. C5.1.5.
متن کاملConstructive Induction of Cartesian Product Attributes
Constructive induction is the process of changing the representation of examples by creating new attributes from existing attributes. In classi cation, the goal of constructive induction is to nd a representation that facilitates learning a concept description by a particular learning system. Typically, the new attributes are Boolean or arithmetic combinations of existing attributes and the lea...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1994